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DETAILED ACTION 
Priority 

1 . Receipt is acknowledged of papers submitted under 35 U.S.C. 1 19(a)-(d), wliich 
papers have been placed of record in the file. 

Drawings 

2. The drawings are objected to because figure 5 has a misspelled label of "filid 
result" which ought to be amended to "filled result". Corrected drawing sheets in 
compliance with 37 CFR 1.121(d) are required in reply to the Office action to avoid 
abandonment of the application. Any amended replacement drawing sheet should 
include all of the figures appearing on the immediate prior version of the sheet, even if 
only one figure is being amended. The figure or figure number of an amended drawing 
should not be labeled as "amended." If a drawing figure is to be canceled, the 
appropriate figure must be removed from the replacement sheet, and where necessary, 
the remaining figures must be renumbered and appropriate changes made to the brief 
description of the several views of the drawings for consistency. Additional replacement 
sheets may be necessary to show the renumbering of the remaining figures. The 
replacement sheet(s) should be labeled "Replacement Sheet" in the page header (as 
per 37 CFR 1 .84(c)) so as not to obstruct any portion of the drawing figures. If the 
changes are not accepted by the examiner, the applicant will be notified and informed of 
any required corrective action in the next Office action. The objection to the drawings 
will not be held in abeyance. 
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Speciflcation 

3. The disclosure is objected to because of tlie following informalities: 
Page 16, line 10:"construcging" ought to be amended to "constructing". 

Appropriate correction is required. 

Claim Rejections - 35 USC § 102 

4. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 
States. 

5. Claims 1-12 are rejected under 35 U.S.C. 102(b) as being anticipated by 
Altunbasak et al. (US Patent 6,597,816 B1). 

Regarding claim 1 , Altunbasak et al. discloses in a lens distortion factor 
calculating apparatus and method for subjecting an image picked up by image pick-up 
means having a lens to lens distortion correction, the lens distortion factor calculating 
apparatus comprises: 

a) first means (Equations 33 and 34 in column 1 1 which is illustrated in fig. 2) 
for finding, on the basis of two images (fig. 2, numerals 210 and 230) picked up by the 
image pick-up means (fig. 1 , num. 1 10 is an image capture device in col. 2, line 39.), the 
coordinates (A point in image 210 is in the upper left corner and a point in image 230 is 
in the lower right corner.) of a plurality of corresponding points (The points in images 
210 and 230 is the same point but moved from image 210 to image 230 as mentioned in 
col. 11, lines 40-46.) between the images (fig. 2, numerals 210 and 230); 
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b) second means (Affine motion model in col. 12, lines 62-64 is applied to 
equations 33 and 34 as mentioned from col. 12, line 62 to col. 13, line 25.) for 
calculating, on the basis of the coordinates (A point in image 210 is in the upper left 
corner and a point in image 230 Is in the lower right corner.) of the corresponding points 
(The points in images 210 and 230 is the same point but moved from image 210 to 
image 230 as mentioned in col. 1 1 , lines 40-46.) found by the first means (Equations 33 
and 34 in column 1 1 which is illustrated in fig. 2), geometric transform factors ((Xg, yg) 
and (x,y) are geometric transform factors: (Xg, yg) is a distorted pixel position in the 
image of figures 220 and 240 that correspond with images of 210 and 230, respectively, 
and (x, y) is the corrected pixel position that corresponds with the images of fig. 210 and 
230 and mentioned col. 1 1 , lines 40-45 and 65-67.) between said two images (fig. 2, 
numerals 210 and 230); and 

c) third means (equation 42:^ is derived from the first and second means.) 
for calculating, on the basis of coordinates (A point in image 210 is in the upper left 
corner and a point in image 230 is in the lower right corner.) of the corresponding points 
(The points in images 210 and 230 is the same point but moved from image 210 to 
image 230 as mentioned in col. 1 1 , lines 40-46.) found by the first means (Equations 33 
and 34 in column 1 1 which is illustrated in fig. 2) and the geometric transform 
factors((Xg, yg) and (x,y)) found by the second means (Affine motion model in col. 12, 
lines 62-64), a lens distortion factor (K7 is the claimed lens distortion factor; the equation 
of V is a function of lens-distortion K7 in col. 1 1 , line 65 and col. 1 3, lines 34,35.) 



Application/Control Number: 09/988,630 Page 5 

Art Unit: 2621 

Regarding claim 2, Altunbasak et al. discloses the lens distortion factor 
calculating apparatus according to claim 1 , characterized in that the first means 
comprises: 

a) means ("motion estimation" models from col. 1 , line 67 to col. 2, line 3.) 
for extracting ("recognized" in col. 2, line 1) an overlapped portion ("successive 
overlapping images" in col. 1, lines 64,65) of the two images (fig. 2, numerals 210 and 
230 are successive overlapping images.) picked up by the image pick-up means (fig. 1 , 
num. 110 is an image capture device in col. 2, line 39.), 

b) means for extracting, from the overlapped portion ("successive 
overlapping images" in col. 1, lines 64,65) of one of the images (fig. 2, num. 210) with 
the other image (fig. 2, num. 230), a plurality of partial images ("small rectangular 
regions" in col. 13, line 43) effective for tracking (Using optical flow a trajectory of a pixel 
is followed as mentioned in col. 2, lines 52,53. The small rectangular regions 
correspond to Xg, which is a "OFE [optical flow equation]... equation" as mentioned in col. 
1 1 , lines 54-64.) by an optical flow (Section: "Optical flow" in col. 2, line 51 has an OFE 
equation 10 located in column 4.) between both the images (Fig. 2, numerals 210 and 
230 which correspond to equation 10 with two images h and I2 .) as feature points 
(rectangular "regions with features" as mentioned in col. 13, lines 41-47), and 
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c) means for tracking a point (A "motion vector" is used for each pixel in col. 
2, lines 22-26 and col. 5, lines 10,11.), which corresponds (The motion vector is used 
for mapping pixels from one frame to another in col. 12, lines 62-63. Note that a motion 
vector is generated in an affine motion model which represents a vector as a set of 
parameters and pixel location as mentioned in col. 5, lines 13-15 and col. 6, lines 
48,49.) to each of the feature points (The affine motion model is used with the 
rectangular "regions with features" as mentioned in col. 13, lines 41-53.) on the one 
image (fig. 2, num. 210), on the other image (fig. 2, num. 230) on the basis of the optical 
flow (The affine motion model represents a motion vector is based on optical flow 
equation. The equation at the bottom of column 6 is based on equation 9 in column 3 
which is an optical flow equation described in the section of "Optical flow" from col. 2, 
line 51 to col. 4, line 67.) between both the images (Equations 38 and 39 in column 13 is 
a mapping from one frame to another frame as mentioned in col. 13, lines 19,20 
Additionally, fig. 2 shows the mapping from one frame to another.). 

Claim 3 was addressed in claim 1 . 

Claims 4,6,8,10 and 12 were addressed in claim 2. 

Claim 5 is similar to claim 1 except for the limitation of a computer readable 
recording medium (fig. 1, num. 130) having a lens distortion factor calculation program 
(fig. 1, num. 130 has "instructions" in col. 2, lines 40,41.) which is disclosed by 
Altunbasak et al. 
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Claim 7 is similar to claim 1 except for the additional limitations of a means and 
method: 

d) fourth means ("Linearization in Geometric Correction" in col. 14, line 1 and 
shown in fig. 3, numerals 330-350.) for subjecting the first image (fig. 2, num. 210) and 
the second image (fig. 2, num. 230) to lens distortion correction (The step in fig. 3, 
numerals 330-350 determines Ky as the lens distortion factor as mentioned in col. 14, 
lines 36,37 that is used in equations 38 and 39 where x' and y' are corrected pixel 
positions as mentioned in col. 1 1 , lines 66,67.) on the basis of the lens distortion factor 
(K7 is the claimed lens distortion factor; the equation of V is a function of lens-distortion 
K7 in col. 11, line 65 and col. 13, lines 34,35.) calculated by the third means (equation 
42:^ calculates initial values in fig. 3 step 320 which are used by steps 330-350 as 
mentioned in col. 13, lines 50-53.); and 
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e) fifth means for combining the first image (fig. 2, num. 21 0) and the second 
image (fig. 2, num. 230), which have been subjected to the lens distortion correction 
(The step In fig. 3, numerals 330-350 determines K7 as the lens distortion factor as 
mentioned in col. 14, lines 36,37 that is used in equations 38 and 39 where x' and y' are 
corrected pixel positions as mentioned In col. 11, lines 66,67.), obtained by the fourth 
means ("Linearization in Geometric Correction" in col. 14, line 1 and shown In fig. 3, 
numerals 330-350 uses (Xg, yg) and (x,y) for computing parameters as mentioned In col. 
1 1 , line 57-65 for fig. 3, num. 320.) using the geometric transform factors ((Xg, yg) and 
(x,y) are geometric transform factors: (Xg, yg) is a distorted pixel position in the image of 
figures 220 and 240 that correspond with images of 210 and 230, respectively, and (x, 
y) is the corrected pixel position that corresponds with the images of fig. 210 and 230 
and mentioned col. 1 1 , lines 40-45 and 65-67.) between the first image (fig. 2, num. 
210) and the second Image (fig. 2, num. 230) which have been subjected to the lens 
distortion correction (The step in fig. 3, numerals 330-350 determines K7 as the lens 
distortion factor as mentioned in col. 14, lines 36,37 that Is used In equations 38 and 39 
where x' and y' are corrected pixel positions as mentioned in col. 11, lines 66,67.). 

Claim 9 was addressed In claim 7. 

Claim 1 1 was addressed in claims 5 and 7. 
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Conclusion 



6. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 

SzeliskI et al. (US Patent 6,157,747 A) is pertient as teaching a method of using 
optical flow with overlapping images to prevent lens distortion as mentioned from col. 3, 
line 66 to col. 4, line 7. 

7. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Dennis Rosario-Vasquez whose telephone number is 
703-305-5431. The examiner can normally be reached on 9-5. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Leo Boudreau can be reached on 703-305-4706. The fax phone number for 
the organization where this application or proceeding is assigned is 703-872-9306. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 
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